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DETAILED ACTION 

1 . The response received on June 16, 2004 has been placed in the file and was considered by the examiner. An 
action on the merits follows. 

Response to Arguments 

2. The apphcant's arguments, filed on June 16 2004, have been fully considered. A response to these 
arguments is provided below. 

35 use 112, Second Paragraph Rejections 

Summary of Argument: The applicant has amended claims 5 and 16 to correct the existing 1 12 - 2""* issues 
and argues that the previous rejection should be withdrawn. 

Examiner 's Response: The applicant's amendment and subsequent argument has been considered and is 
persuasive. The previous 35 USC 112-2'''^ paragraph rejections are hereby withdrawn. 

Prior Art Rejections 

Summary of Argument: The applicant argues that the references cited in the previous action fail to disclose 
the steps performed by the extraction and deletion means of claim 1 (these steps are recited in other claims as well). 
Additionally the applicant argues that the cited prior art fails to disclose the steps performed by the determination, 
extraction and deletion means of claim 25 (these steps are performed in other claims as well). 

Examiner 's Response: The applicant's arguments have been fully considered but are not persuasive. The 
limitations defined by the extraction and deletion means of the newly amended claim 1 were previously recited in 
the original claim 1. Therefore, these limitations are met by the Laumeyer reference as described in the previous 
rejection of claim 1, and further described in the below rejection of claim 1. 

The limitations defined by the determination, extraction and deletion means of newly amended claim 25 
were previously recited in the original claim 7. Therefore, these limitations are met by the Laumeyer reference as 
described in the previous rejection of claim 7, and further described in the below rejection of claim 25. 

Claim Objections 

3. Claims 19 and 26-28 are objected to because of the following informalities: 

• Claim 1 9 is objected to because of the unintelligible wording of the claim. It appears as if an 
important phrase or sentence has been inadvertently deleted or omitted. This absent smtence or 
phrase should probably be inserted between the words "data" and "match" of the currently recited 
claim. 
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• Claims 26-28 are objected to because the phrase "by a plurality of capture", should be followed by 
an appropriate noun. As currently recited, it is followed by the word "and". 

• Claims 1, 23, 24 and 29 are objected to because the sentence which contains the phrase "whose 
position data nearly matches from said plural pieces" is a run-on sentence which causes confiision 
when reading the claim. This problem can be easily remedied by inserting a comma after the 
phrase "whose position data nearly matches". 

Appropriate correction is required. 

Claim Rejections - 35 USC§112 

4. The following is a quotation of the second paragraph of 35 U.S.C 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

5. Claims 19-21 and 26-28 are rejected under 35 U.S.C. 112, second paragraph, as being indefinite for failing 
to particularly point out and distinctly claim the subject matter which applicant regards as the invention. 

With regard to claim 19, the limitations of the claim are not clear as a result of the grammatical issues 
discussed in the above claim objections. 

With regard to claims 26-28, the limitations of these claims are not clear as a result of the grammatical 
issues discussed in the above claim objections. 

Claims 20 and 21 are rejected because they are dependent on indefinite claims. 

Double Patenting 

6. Applicant is advised that should claims 1 or 25 be found allowable, claims 29 and 30, respectively, will be 
objected to under 37 CFR 1.75 as being a substantial duplicate thereof When two claims in an application are 
duplicates or else are so close in content that they both cover the same thing, despite a slight ditference in wording, 
it is proper after allowing one claim to object to the other as being a substantial duplicate of the allowed claim. See 
MPEP § 706.03(k). 

Claim Rejections - 35 USC §102 

7. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the basis for the 
rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(e) the invention was described in (1) an application for patent, published under section 122(b), by another filed 
in the United States before the invention by the applicant for patent or (2) a patent granted on an application for 
patent by another filed in the United States before the invention by the applicant for patent, except that an 
international application filed under the treaty defined in section 35 1 (a) shall have the effects for purposes of this 
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subsection of an application filed in the United States only if the international application designated the United 
States and was published under Article 21(2) of such treaty in the English language. 

8. Claims 1, 4, 5, 10, 12, 15, 16, 21 and 23-30 are rejected under 35 U.S.C 102(b) as being anticipated by 
Laumeyer et al. (USPN 6,266,442 Bl). 

With regard to claim 1, which is representative of claims 12 and 29, Laumeyer discloses holding means for 
holding plural pieces of frame data (col. 12 lines 61-62) obtained from image data input at a plurality of positions 
(col 10 lines 40-59). The "image hst" database disclosed in Laumeyer is analogous to the holding means recited in 
the claim. Laumeyer fiirther discloses that the positions are associated with position data obtained based on GPS, 
that indicate a position at which each piece of frame data is captured (col. 5 lines 45-54 & col. 10 lines 34-39) 

Laumeyer fiirther discloses means for extracting frame data whose position nearly matches, from the plural 
pieces of frame data held by the holding means (see Figure 4). The bitmap sign regions correlated to classified 
triangulated location disclosed in Laumeyer are analogous to frame data whose position nearly matches as recited in 
the claim. The saving of bitmapped sign regions and the subsequent pair matching algorithm as disclosed in 
Laumeyer qualify as the exfraction step recited in the claim. 

Laumeyer further discloses a means for deleting frame data overlapping another piece of extracted frame 
data (Figure 4). Removing matched pairs from the search space as disclosed in Laumeyer is analogous to deleting 
overlapping frame data as recited in the claim. 

Laumeyer further discloses means for storing, after associating with a position on the map, remaining frame 
data after the deletion process (Figure 4). The "sign Hst" storage spot disclosed in Laumeyer is analogous to the 
storing means recited in the claim in that the matching images are stored in the sign list storage spot after they are 
deleted from the holding means (Figure 4 and col 13 lines 54-60). 

Laumeyer further discloses that the frame data stored in the holding means (image list database) is 
associated with position data indicating a position at which each piece of frame data is captured (col. 5 lines 45-54). 
Laumeyer further discloses that the extraction means extracts frame data matching in position data (the "image list" 
box of Figure 4). The frame data in Laumeyer are extracted according to their triangulated location. Please note 
that the triangulated location is determined based on the position at which each piece of frame data is captured (col. 
5 lines 45-54) and consequently qualifies as the position data recited in the claim. 

With regard to claim 23, a computer-executable program comprising code which causes the computer to 
execute the steps of a method is essential if the image processing method disclosed in Laumeyer is to function. 
Therefore, a computer-executable program is inherent in the teachings of Laumeyer. 

With regard to claim 24, a storage medium that stores a computer-executable program Miiich causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in Laumeyer is to 
function. Therefore, a storage medium is inherent in the teachings of Laumeyer. 

With regard to claim 4, which is representative of claim 15, Laumeyer further discloses that image data is 
captured with a plurality of moving capture devices for capturing different directions (Figures 3 A and 3B). The 
capture devices 10,20,30,40 move with the vehicle and capture different directions. Laumeyer further discloses that 
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position data is obtained from a distance meter for measuring a moving distance of a moving object which moves 
with said plurality of capture devices (col. 5 lines 45-54). The inertial navigation system INS disclosed in Laumeyer 
is a distance meter which measures a moving distance of a moving object. 

With regard to claim 5, which is representative of claim 16, Laumeyer discloses a setting means for setting 
sampling intervals of frame data (col. 5 lines 32-33). Laumeyer discloses a camera with a frame rate, hiheretit in 
any camera with a given frame rate is a setting means for setting the frame rate. For any given frame rate (set by a 
setting means), the sampling interval (distance between captured frames) will vary proportionally with the driving 
speed. For example, the sampling interval of a capture device with a given frame rate will increase with increased 
driving speed and decrease with decreased driving speed. As a result, we can conclude that Laumeyer inherently 
teaches a setting means for setting the sampling interval. Laumeyer further discloses an extraction means which 
extracts two images (frame data) which have a corresponding location (col. 18 lines 25-29 and Figure 4). Since 
these locations are equivalent, it follows that the position data distance is shorter than the sampling interval distance. 

With regard to claim 25, which is representative of claims 26 and 30, Laumeyer further discloses a 
determination means for comparing two pieces of frame data and determining whether or not the two pieces of 
frame data have been captured at the same position (Figure 4). Figure 4 shows correlating frame data based on 
location. Correlating frame data based on location as disclosed in Laumeyer qualifies as determining whether or not 
two pieces of frame data have been captured at the same position as recited in the claim. Laumeyer further discloses 
extracting the frame data that the determination means determines has been captured at the same position (Figure 4). 

With regard to claim 27, a computer-executable program comprising code which causes the computer to 
execute the steps of a method is essential if the image processing method disclosed in Laumeyer is to function. 
Therefore, a computer-executable program is inherent in the teachings of Laumeyer. 

With regard to claim 28, a storage medium that stores a computer-executable program which causes the 
computer to execute the steps of a method is essential if the image processing method disclosed in Laumeyer is to 
function. Therefore, a storage medium is inherent in the teachings of Laumeyer 

With regard to claim 10, which is representative of claim 21, Laumeyer discloses that image data is 
captured while a plurality of capture devices are moving when capturing images in different directions (Figure 3B). 
Figure 3b shows cameras which capture images in different directions while moving as the vehicle is moving. 
Laumeyer further discloses that the frame data adopted by said determination means is obtained by a capture device 
facing in a direction vertical to a moving direction (Figures 3 A and 4). Figure 3 A shows cameras 10 which face in a 
direction vertical to the moving direction. Figure 4 shows that the frame data captured in this front facing direction 
is used by the determination means. 

Claim Rejections - 35 USC § 103 

9. The following is a quotation of 35 U.S.C. 103(a) \diich forms the basis for all obviousness rejections set 
forth in this Office action: 
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(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 8, 9, 19 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Laumeyer as applied to 
claims 1, 7, 12 and 18 above, and further in view of Hsu (USPN 6,587,601 Bl). The arguments as to the relevance 
of Laumeyer as applied in paragraph 2 above are incorporated herein. 

With regard to claim 8, which is representative of claim 19, Laumeyer discloses determining whether or not 
two pieces of frame data were captured at the same position. Laumeyer discloses that the two pieces of frame data 
match when they correspond to the same location. It follows that the relative distance between the pieces of frame 
data must be equal to or smaller than a predetermined value of 0. Laumeyer fails to expressly disclose making that 
determination by computing a least squares error between two pieces of frame data. 

Hsu, however, discloses computing the least squares error between two pieces of frame data (Hsu column 
10 lines 12-57). The video frame image and reference frame image discloses in Hsu are analogous to the two pieces 
of frame data as recited in the claim. It would have been obvious to one reasonably skilled in the art at the time of 
the invention to modify Laumeyer' s image capture location matching system to include that a relative distance 
between two image frames is computed using a least squares error method as taught by Hsu. Such a modification 
would have allowed for a system that could match image capture locations that were very similar but not exactly the 
same. This would have made for a more flexible and robust system. 

With regard to claim 9, which is representative of claim 20, Hsu fixrther discloses that the determination of 
the least squares error, which computes a relative distance between two pieces of frame data, is based on 
corresponding points of the two pieces of frame data (Hsu col. 10 line 30 equation 3). 

10. Claims 11 and 22 arerejected under 35 U.S.C. 103(a) as being unpatentable over Laumeyer as applied to 
claims 1 and 12 above, and fiirther in view of Miwa et al. (EP 977 014 A2). The arguments as to the relevance of 
Laumeyer as applied in paragraph 2 above are incorporated herein. 

With regard to claim 1 1, which is representative of claim 22, The claim recites a means for setting the 
sampling interval of frame data, a means for obtaining a plurality of pieces of frame data over a distance 
corresponding to two points on a map, a means for using the sampling interval and the distance between the points 
to determine the number of frames that should be taken between the two points, and a means for thinning out the 
captured number of frames, Laumeyer discloses a camera with a frame rate (Laumeyer col. 5 lines 32-33). The 
camera inherently comprises a means for setting this frame rate. For a given frame rate, the sampling interval 
(distance between captured frames) will vary based on the driving speed. The sampling interval of a capture device 
with a given frame rate will increase with increased driving speed and decrease with decreased driving speed. As a 
result, we can conclude that Laumeyer inherently teaches a setting means for setting the sampling interval. 
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Laumeyer further discloses a means for obtaining a plurality of pieces of frame data over a distance 
corresponding to two points on a map (Laumeyer Figure 3b). Figure 3b shows a traveling vehicle with side facing 
cameras 20 and 30 that obtain plural pieces of frame data as the vehicle moves in the forward direction. As the 
vehicle moves in a forward direction, the side facing cameras capture frame data along a line between two points on 
a map. This is inherent in the teachings of Laumeyer because the side facing cameras will always capture a frame 
data group corresponding to a line between any two points on a map that the vehicle passes by. 
Laumeyer fails to expressly disclose a means for using the sampling interval and the distance between two points on 
a map to determine the number of frames between the two points, or a means for thinning out the captured number 
of frames. Miwa, however, discloses a means for determining the number of frames between two points by using 
the sampling interval and the distance between two points (Miwa col. 1 lines 14-21). Miwa discloses storing plural 
frame data (series shots) along a road in a storing portion and having the position data of each of the frames stored 
along with the frame. As a result, the number of image frames between two given points can be computed based on 
the distance between those two points and the sampling interval (or distance between individual image frames). 
Miwa fiirtha discloses performing a thiiming operation on the captured number of frames (Miwa col. 2 lines 42-45). 
It would have been obvious to one reasonably skilled in the art at the time of the invention to modify Laumeyer's 
image processing apparatus by determining the number fo frames to be captured over a given area and then 
performing a thiiming operation on those frames as taught by Miwa. Such a modification would have allowed for a 
system of capturing images that allowed the frame data to be thinned such that all the captured frames could be 
obtained and none of the frames would have to be discarded. 



Conclusion 

1 1 . Applicant's amendment necessitated the new ground(s) of rejection presented in this Office action. 
Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension 
of time policy as set forth in 37 CFR LI 36(a). 

A shortened statutory period for reply to this final action is set to expire THREE MONTHS from the 
mailing date of this action. In the event a first reply is filed within TWO MONTHS of the mailing date of this final 
action and the advisory action is not mailed until after the end of the THREE-MONTH shortened statutory period, 
then the shortened statutory period will expire on the date the advisory action is mailed, and any extension fee 
pursuant to 37 CFR 1. 136(a) will be calculated from the mailing date of the advisory action. In no event, however, 
will the statutory period for reply expire later than SIX MONTHS from the date of this final action. 



12. Any inquiry concerning this communication or earlier communications from the examiner should be 
directed to Patrick L Edwards whose telephone number is (703) 305-6301. The examiner can normally be reached 
on 8:30am- 5:00pm M-F. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's supervisor, Leo Boudreau 
can be reached on (703) 305-4706. The fax phone number for the organization where this application or proceeding 
is assigned is 703-872-9306. 

Information regarding the status of an application maybe obtained from the Patent Application Information 
Retrieval (PAIR) system. Status information for published applications may be obtained from either Private PAIR 
or Public PAIR. Status information for unpublished applications is available through Private PAIR only. For more 
information about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access to the 
Private P/UR system, contact the Electronic Business Center (EEC) at 866-217-9197 (toll-free). 
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